@ Processing Digital Imagery To Enhance Perceptions of Realism 

Perceptible color and detail are superior to those of other image-enhancement methods. 
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Multi-scale retinex with color restora- 
tion (MSRCR) is a method of processing 
digital image data based on Edwin 
Land’s retinex (retina + cortex) theory 
of human color vision. An outgrowth of 
basic scientific research and its applica- 
tion to NASA’s remote-sensing mission, 
MSRCR is embodied in a general-pur- 
pose algorithm that greatly improves the 
perception of visual realism and the 
quantity and quality of perceived infor- 
mation in a digitized image. In addition, 
the MSRCR algorithm includes provi- 
sions for automatic corrections to accel- 
erate and facilitate what could otherwise 
be a tedious image-editing process. The 
MSRCR algorithm has been, and is ex- 
pected to continue to be, the basis for 
development of commercial image-en- 
hancement software designed to extend 
and refine its capabilities for diverse ap- 
plications. 

Initially, a color image is divided spa- 
tially into pixels and, within each pixel, 
intensity levels are digitized in S spectral 
bands. Hence, the initial image data are 
in the form Ifx,y), where x and y are 
Cartesian pixel coordinates and the sub- 
script i denotes the zth spectral band. 
The MSRCR algorithm begins with the 
computation of an adjusted value of 
each Ii(x,y) in accordance with 
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where w n is the nth of N weigh ting fac- 
tors, F n (x,y) is the nth of N surround 
functions, and denotes the convolu- 
tion operator. Each surround function is 
uniquely scaled to improve an aspect of 
the digital image; e.g., dynamic range 
compression, color constancy, or light- 
ness rendition. The adjusted intensity 
value for each spectral band at each po- 
sition is filtered with a common function 
and then presented to a display device. 
In the case of a color image, a color- 
restoration step (essentially, an addi- 
tional filtering step) is included to make 


the image give rise to a human percep- 
tion of color that closely matches the 
color perception of a human viewing the 
original scene depicted in the image. 

In the perception of a human viewer, 
a digital image enhanced by the MSRCR 
algorithm resembles the original scene, 
under all kinds and levels of lighting, 
more closely than does a digital image of 
the same scene enhanced by any prior 
known image-data-processing algorithm. 


Other attributes that make the MSRCR 
algorithm superior to other such algo- 
rithms include the following: 

• Because all of the desired image- 
enhancement and -correction func- 
tions are performed in a single step, it 
is much easier for consumers to use 
software based on the MSRCR algo- 
rithm to obtain high-quality digital im- 
ages. For the same reason, significantly 
less processing time is needed. No 
manual manipulations of data are re- 
quired. However, the user is given the 
option, at the end, to perform any de- 
sired additional manipulations of data. 

• The MSRCR algorithm is able to en- 
sure that details are not lost when illu- 
mination conditions are not optimal 
(i.e., in shadowed or brightly illumi- 
nated zones of an image, as shown in 
the figure). The algorithm also en- 


sures that colors in shadowed or 
brightly illuminated areas are not lost 
or severely attenuated. 

Commercial software, Photoflair for 
Windows, based on the MSRCR algo- 
rithm is now available for use by ama- 
teur photographers to optimize bright- 
ness and contrast and to enhance detail, 
and overall sharpness and quality of im- 
ages. There are numerous other poten- 
tial applications in medical imaging, 


forensic imaging, and editing of motion 
pictures. 

This work was done by Glenn A. Woodell 
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Center and Zia-ur Rahman of TruView Imag- 
ing Co. For further information, please contact 
Mr. Zia-ur Rahman, telephone (757) 766- 
5850 or send e-mail to zrahman@truview.com. 
For information on Photoflair product see www. 
truview.com, for information on NASA tech- 
nology see www.dragon.larc.nasa.gov/retinex. 
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Original Image Image After Processing by Software 

Based on the MRSCR Algorithm 


Details in Shadows are more readily perceptible after processing by software based on the MSRCR 
algorithm. 
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